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(57) Abstract 



An improved image processing method which uses a modified Walsh-Hadamard transform to remove noise and pre- 
serve image structure in a sampled image. Image signals representative of the light value of elements of the image are 
grouped into signal arrays corresponding to blocks of image elements. These signals are mapped into larger signal arrays 
such that one or more image signals appear two or more times in each larger array. The larger arrays are transformed by 
Walsh-Hadamard combinations characteristic of the larger array into sets of coefScient signals. Noise is reduced by modi- 
fying-i.e., coring or clipping- and inverting selected coefficient signak so as to recover processed signals-less noise-rep- 
resentative of each smaller signal array. The results exhibit acceptable rendition of low contrast detail while at the same 
time reducing certain processing artifacts characteristic of the unimproved Walsh-Hadamard block transform. 
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IMAGE PROCESSING METHOD USING A 

COLLAPSED WALSH^HADAMARD TRANSFORM 

BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The Invention relates to an Image 

processing method of the type using the 
Walsh-Hadamard transform to operate upon arrays of 
Image signals representative of the light value of 
elements of an Image* 

10 Description Relative to the Prior Art 

Image processing methods using the 
Walsh'-Hadamard transform are well known to those of 
ordinary skill In the Image processing art. For 
that reason, the description relative to the prior 

15 art and relative to an embod5^ent of the Invention 
will Include only such detail regarding the 
Walsh^Hadamard transform as Is useful and sufficient 
to describe the Improved use of the transformation 
In accordance with the Invention. For further 

20 Information regarding the Walsh^Hadamard transform, 
reference may be made to Digital Image Processing by 
W. K. Pratt (John Wiley & Sons, New York, 1978) and 
especially chapter 10 thereof, "Two -Dimensional 
Unitary Transforms" and the bibliographic references 

25 cited there li (especially "Hadamard Transform Image 
Coding," by W. K. Pratt, H. C. Andrews, and J. Kane, 
Prog. IEEE , 57, 1, January 1969, 58-68). 

In the Interest of processing efficiency, 
the Walsh-Hadamard transform may be configured to 

30 operate on relatively small arrays of Image signals 
generated from blocks of Image elements— a type "of 
transform processing herein referred to as block 
processing. In addition, the overall process may be 
partitioned Into a number of stages* Such an Image 

35 processing method Is described In United States 
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Patent No* 4,442,454 (issued April 10, 1984), which 
is believed to disclose features closest to the 
present invention* U.S. Patent No. 4,442,454 
represents the earliest publication of the contents 
5 of International Application No. PCT/US83/01778, 
which draws priority from U*S. patent application 
Serial No. 441,826 (now U.S. Patent No* 4,442,454), 
filed November 15, 1982 in the name of the present 
applicant. U.S. Patent No. 4,442,454 describes a 

10 transform processing method that operates in a 
hierarchy of stages, each stage employing a 
Walsh-Hadamard block transform operating on an array 
of image signals derived from a preceding stage. In 
particular, one embodiment shows a 2 by 2 

15 Walsh-Hadamard transform operating on a 2 by 2 array 
of image signals. 

Processed images resulting from an image 
processing method using such a 2 by 2 Valsh-Badamard 
transform often display artifacts introduced by the 

20 processing method itself. These artifacts may be 
suppressed by using a Walsh-Hadamard transform 
operating on a larger array of image signals, such 
as a 4 by 4 array generated from a 4 by 4 block of 
image elements. Such a method --employing a 4 by 4 

25 array-^is described in commonly assigned, copending 

International implication No. 

(corresponding to U.S. patent application Serial No. 
522,284), entitled "Transform Processing Method For 
Reducing Noise In An £nage," and filed on even date 

30 herewith. However, while suppressing these 
artifacts, certain image features, such as 
low-contrast edges, rendered well by the smallei^ 2 
by 2 transform, are relatively degraded by use of 
the larger 4 by 4 transform. Before describing my 

35 solution to this type of problem, it is helpful to 
review certain known aspects of the Walsh-Hadamard 
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trans format ion 9 in both 2 by 2 and 4 by 4 
configurations . 

Starting with a 2 by 2 Wal sh-^Hadamard 
transform, let a 2 by 2 block of image elements be 
represented as a block of four image elements A^j , 
as follows. 



^11 ^12 



A 



21 



i22 



The corresponding image signals are generated from 
10 the light values of these elements (light value, as 
used herein shall mean any image-related 
characteristic--e.g. , lightness, brightness, 
density, hue and the like-- that can be expressed in 
a form suitable for image processing) • The image 
15 signals are represented as an array of four image 
signals , as follows. 



a 



11 



^2 



i2i a22 



An array of four transform coefficient signals c^j , 



20 



'11 



=21 



'12 



'22 



are generated from the Image signals in four linear 
arithmetic combinations characteristic of the 2 'by 2 
Walsh-Hadamard transform, as follows. 
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^11 • ^11 H2 + ^21 ^22 
"=12 • ^11 • ^12 ^ *21 • ^22 
^21 • Hi ^2 * *21 • *22 
^22 • ^11 • *12 • *21 ^ *22 

5 Each coefficient signal is a particular linear 

combination of the light values from image elements 
within the block. Each combination (except 
coefficient signal Cj^^) represents a particular 
component of the image structure ^^such as 

10 detail— and tends to vanish in the absence of that 
particular kind of structure. 

By inspecting these linear arithmetic 
combinations, it can be seen that each coefficient 
signal corresponds to a particular summation of all 

15 the image signals in the block, allowing some image 
signals to be positive (multiplied by +1) and others 
to be negative (multiplied by -1) . In this 
connection. Figure 1 is an abbreviated way of 
listing the arithmetic operations necessary to 

20 generate these linear combinations. The ±1 

multipliers for each linear combination mentioned 
above are grouped into an array of four multipliers, 
each multiplier corresponding in position to the 
image element, and signal, it operates upon. Four 

25 such arrays are provided corresponding to the four 
linear arithmetic combinations mentioned above for 
generating the four coefficient signals. The array 
composed of four +1 multipliers generates an average 
coefficient signal (the Cj^ coefficient signal) 

30 over the 2 by 2 area. The other three arrays - 
generate coefficient signals in response to 
differences in light value between image 
elements— differences that represent image gradients. 
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Noise Is reduced in the processed Image by 
modifying one or more of the coefficient signals. 
The noise reduction process typically involves 
either coring or clipping. Coring is a non-linear 
5 noise reduction process that removes coefficient 
signal energy — presumably noise— near the average 
coefficient signal axis and less than a threshold; 
signal energy in the remaining coefficient signals 
is then combined with low-pass signal energy. 

10 represented by the average coefficient signal. The 
effect of this combination occurs during the Inverse 
transformation of the coefficient signals, which 
will be described further in the upcoming 
description. (See "Digital Techniques of Reducing 

15 Television Noise," by J. P. Rossi, Journal of the 
Society of Motion Picture and Television Engineers > 
March 1978, pp. 134-140.) Clipping is a 
complementary process that removes coefficient 
signal energy- -presumably image detail— that is 

20 above a threshold; the noise signal remaining after 
Inverse transformation is then subtracted from a 
full -band Image signal. 

Processed image signals (representing the 
original image signals less noise) are then 

25 recovered by inverse transforming the coefficient 
signals, including the one or more that were 
modified (and, in the case of clipping, subtracting 
the inverted signals from the full -band image 
signal). Since the Walsh-Hadamard transform is 

30 exactly Invertible, the four processed image signals 
a'j^j are recovered by employing the four 
combinations represented in Figure 1, but now wfth 
the coefficient signals in place of the unprocessed 
image signals (and a proportionality factor of 1/4) , 

35 as follows. 
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^'ll ■ 1/^(^11 ^ ^12 ^21 ^22^ 
a'i2 - 1/^(^11 • <^12 + <=21 - ^22> 
a'21 - l/4(cji + • <^21 " ^22^ 
a '22 - 1/^C<^11 ^12 • ^21 ^ ^22^ 

5 The 2 by 2 Walsh-Hadamard transform 

performs particularly well In reconstructing small, 
local image gradients such as found in lovcontrast 
detail, like edges. However, any coefficient signal 
sensitive to a block-wide local gradient is 

10 similarly sensitive to segments of more extended 
gradients. For example, a coefficient signal 
generated from a block covering only a few image 
elements not only responds to the abrupt change of a 
small, local gradient, e.g., a low contrast edge, 

15 but also responds to a graduial change in a smooth, 
extended image gradient-*such as is frequently found 
within smooth areas of scene objects. An artifact 
arises when a threshold set up to distinguish low 
contrast detail in a local block is "falsely" 

20 triggered by a smooth, extended gradient. Then, an 
abrupt discontinuity-much like an "edge"~will 
undesirably appear in the processed image at the 
point where the threshold is crossed and the 
corresponding linear combination is undesirably 

25 modified. Hence the name "false edge" artifact is 
given to such unwanted transitions arising from use 
of a method such as described in the aforementioned 
U.S. Patent No. 4,442,454. 

The heretofore-cited patent application 

30 Serial No. 522,284, describes a transform processing 
method that suppresses the "false edge" artifact by 
modifying— i.e. , coring or clipping— and inverting 
only selected transform coefficient signals from 
each array of signals c^y In order to do this 

35 with the Walsh-Hadamard transform, it is necessary 
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to transform a larger number of image signals than 
are provided by a 2 by 2 block of image elements. 
The size suggested in Serial No. 522,284 is one 
including signals from a 4 by 4 block of image 
elements • 

Apart from involving a larger blpck of 
image elements and therefore involving a greater 
number of linear combinations , the operation of the 
4 by 4 Walsh-Hadamard transform is analogous to that 
of the 2 by 2 Valsh^Hadamard transform. As an 
example, let a 4 by 4 block of image elements be 
represented as a block of sixteen image elements 



IS 



^11 -^12 ^13 ^14 

^21 Ht Hz Hh 

^31 -^32 -^33 -^34 

-^41 ^42 ^43 -^44 



and Che image signals obtained from the 
corresponding light values as an array of sixteen 
2Q image signals ej[jt as follows. 



'11 *12 «13 «14 
^21 *22 *23 ^24 



'31 
'41 



^32 ^33 
*42 ^43 



«34 
^44 



25 An array of sixteen coefficient signals c^j , 



*^11 ^12 . <^13 «14 

*^21 C22 <^23 <=24 

*^31 <^32 <^33 *^34 

°41 «42 <=43 ^44 
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is generated from the image signals in sixteen 
linear arithmetic combinations characteristic of the 
4 by 4 Valsh*Hadamard transform, as follows (in 
part) . 

^ ^ll'®ll*^12*^13"^14^21+^22+^23^24 
+a3j^+a32+a33+a34+a^j+a42+^43*^44 

«^12"^11+^12"^13^^14"^21^22"^23"^24 
+^31+^32^*33"'^34"^41*^42"^43"*44 

^13*ni-^12"^13"^14"^21'^22'^23+^24 
0 +a31-^32-^33"^34'^41 •^42*H3"'^44 



^44'ail-^12"*^13"^14*^21^22*^23"*^24 
15 +*31*^32^33"^34^^41^42*H3^44 

Figure 2 is a list of the sixteen arrays of ±1 
multipliers used in these sixteen arithmetic 
combinations for generating the corresponding 
sixteen coefficient signals c^j . (It will be 

20 evident from Figure 2 how to form the arithmetic 
combinations not shown above.) Apart from the 
average coefficient signal c^^^^, each coefficient 
signal is generated from differences in light value 
between image elements within the 4 by 4 block. 

25 When the transform coefficient signals from 

the preceding 4 by 4 Walsh-Hadamard transform are 
processed in accordance with the heretofore-cited 
Serial No. S22,284~that is, by modifying and " 
inverting all but selected coefficient signals— the 

30 "false edge" artifact in the processed image is 
reduced. However, low-contrast detail in the 
processed image now suffers in comparison to the 
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output £rom a transformation method based on use of 
the 2 by 2 Walsh-Hadamard transform, such as 
described in the heretofore cited U.S. Patent No. 
4,442,454- The choice of the transform block size 
5 involves a trade-off between suppression of artifact 
and rendition of certain types of image structure, 
especially low contrast detail* From an aesthetic 
viewpoint, such artifacts detract from the overall 
visual appeal of images processed by such methods » 

10 On the other hand, the preservation of low-contrast 
detail in the processed image la desirable for 
aesthetic reasons • Whichever Walsh-Hadamard 
transfoirm is chosen, the resulting processed image 
has aspects that are aesthetically unappealing. My 

15 Invention provides more appealing results by 

striking a better balance between artifact and image 
structure. 

SUMMARY OF THE INVENTION 
I have found that the Walsh-Hadamard 

20 transform can be used to better advantage in block 
processing if the transform generates its 
characteristic linear combinations from an 
unconventional ordering of the image signals 
available to the transform. More specifically, the 

25 nrray of image signals obtained from a specific 
block, e.g., 3 by 3, of image elements are mapped 
into a larger array of image signals, e.g., 4 by 4. 
The larger array. Including some Image signals that: 
appear more than once, is then transformed in 

30 accordance with the characteristic Walsh-Hadamard 
linear combinations appropriate for the larger 
array. In effect, the Walsh-Hadamard transformation 
method is collapsed upon a smaller block of image 
elements than is usual for the given size of 

35 transform. By completing the coefficient 

modification and inverse transforming with respect 
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to the larger signal array, a better compromise Is 
struck between the removal of "false edge" artifacts 
'and the preservation of low"*contrast detail. 

The image processing method in accordance 
5 with the invention is an improvement upon prior 
image processing methods using the Walsh -Hadamard 
transformation.. Image signals representative of the 
light value of elements of the image are grouped 
lAto arrays of signals prior to being transformed. 

10 The signals comprising these arrays are fever than 
the number of signals ordinarily required by the 
particular size of Walsh^^Hadamard transform in ude» 
The improvement comprises mapping these fewer 
signals into yet larger signal arrays such that one 

15 or more image signals appear two or more times In 
the larger array. Then the larger number of signals 
comprising these larger arrays are transformed in 
accordance with the Walsh -Hadamard linear 
combinations appropriate for the larger array. 

20 More specifically, the invention provides 

an improved method of transform processing of an 
image for both reducing noise and preserving image 
structure, particularly low contrast detail. One or 
more of the coefficient signals resulting from 

25 transformation of the above-mentioned larger arrays 
are modified— as by coring or clipping— in order to 
reduce noise in the processed image, while 
preserving the residual image structure. Finally,, 
the processed image having reduced noise is 

30 generated from these coefficient signals, some of 
which may have been modified in the preceding 
steps. r 
BRIEF DESCRIPTION OF THE DRAWINGS 
The invention will be described with 

35 reference to the figures, wherein: 

Figures 1 and 2 are tabular listings of the 
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arithmetic combinations for generating the 
coefficient signals of a 2 by 2 and 4 by 4 
Walsh-Hadamard transform, respectively; 

Figure 3 1$ a tabular listing of the 
5 arithmetic combinations for generating the 

coefficient signals characteristic of a 4 by 4 
Walsh-Hadamard transform but "collapsed" upon a 3 by 
3 field of image elements in accordance with the 
invention; 

10 Figure 4 is a block diagram of an image 

processing method in accordance with the invention; 

Figures 5A and 5B are diagrams of the 
weighting arrays used for the prefilters of Figure 4; 
Figures 6A, 6B and 6C are diagrams 
15 illustrating the particular image signals selected 
for trans formit ion at each stage of the method in 
accordance with the embodiment of Figure 4; 

Figure 7 is a generalized circuit diagram 
for implementing the first, second and third stage 
20 filters of Figure 4; 

Figures 8 and 9 are circuit diagrams of the 
pair of averaging prefilters used in Figure 4; 

Figure 10 is a circuit diagram of the 
delay, alignment and summing network utilized in 
25 Figure 4 to receive the full -band signal and the 

signal output from the first, second and third stage 
filters; 

Figure 11 is a circuit diagram of the 
Walsh-Hadamard processor incorporated in Figure 7; 
30 Figure 12 is a circuit diagram of a 

configuration of 1 by 4 arithmetic networks for 
implementing the direct and inverse transformers of 
Figure 11; 

Figure 13 is a circuit diagram of one of 
35 the 1 by 4 arithmetic networks Incorporated in 
Figure 12; and 
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Figure 14 is a circuit diagram of the 
sunimlng components comprising each o£ the 1 by 2 
arithmetic networks incorporated in Figure 13. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
5 The input signal in the following 

description is generated by the scanning and 
sampling of an original image. For purposes of 
describing the preferred embodiment the input signal 
is assumed to be generated from an image such as a 

10 negative or positive photographic transparency. It 
is further understood that such a signal may 
represent a variety of spatial components of the 
image » including ah average light value levels fine 
detail such as fine edges , lines and textures; 

15 intermediate detail such as broader edges and small 
features ; and coarse d itail such as shaded modeling 
and other gradually varying features* (Modeling as 
here used refers to the rendition of smoothly 
varying features or details.) In addition, the 

20 signal includes a noise component affecting most of 
the spatial components to some degree. With a 
photographic transparency, much of such noise 
originates with the random distribution of the 
light -absorbing particles that form the basis of 

25 this image -recording system. While the invention 
will be described in connection with sampled data 
from a photographic transparency, it should be 
understood that the input signal can represent other 
information or data, such as would be derived from 

30 directly scanaf.ng an object, from a composite video 
signal, or from image information in 
optical/electrical/magnetic storage. In such cases 
the noise originates in other characteristics of the 
signal generating system. 
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The invention will be described in 
accordance with a modification applied to a 4 by 4 
Walsh -Hadamard transformation. Ordinarily, in 
taking a 4 by 4 transform of the image signals, the 
signal values involved in the transformation include 
samples taken from 4 elements of 4 lines of the 
original image,- for a total of 16 signals from 16 
samples. I have recognized that the techniques of 
direct and inverse Walsh-Hadamard transformation are 
still useful and valid if the signal values are 
accumulated and ordered in a different pattern. 

More specifically, the sixteen signal 
values for the transformation are taken from the 
nine elements of a 3 by 3 block instead of the 
sixteen elements of a 4 by 4 block. That is, from 
the 3 by 3 block of image elements 









A 1 
^3 




^21 




^23 


20 


^31 


^32 


-^33 



a 3 by 3 array of Image signals a^^ j , 



(2) 



25 



30 



*1X 


&12 


n3 


*21 




^23 


*31 


*32 


^33 



(3) 



is generated from the light values of the image 
elements . 

These nine image signals a-^-^...a.23 ai^e 
mapped into a 4 by 4 array of image signals suitable 
for transformation, as follows. - 



35 



(.^12^ (^12^ ^*13^ 

(ajj^) (a22) (^22) (^23^ 

(a2i) (a22) (^22^ ^^23^ 

ia^l) (332) (^32^ (^33) 



(4) 
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This Is done by using image signals ^i^* 

and oncej ^1^2.' ^ZL* ^23 ^32 
twice; and four times. Aa array o£ sixteen 
coefficient signals c^j. 



10 



15 



<^11 <=12 Cl3 <^14 

*^21 <^22 *^23 <^24 

*^31 C32 C33 «34 

C41 C42 C43 C44 



(5) 



is generated from the 4 by 4 array (4) of image 
signals in sixteen arithmetic combinations identical 
to those used [combinations (1) ] for the 4 by 4 
Valah-Hadamard transform, excepting that certain of 
th6 Image signals appear more than once in a given 
linear combination, as follows (in part). 



20 



'11"*11"**1 2'*"*12'*^15'*^21"'^22''*22'**23 
+a2i+a22'**22'**23"** 31'**32''*32'*"*33 



'12'^11"^*12"*12"®13"*^21'**22"*22"*23 
■*"^21**22 "*22'*23*^31"^32"*32'**33 



25 



*^13"^11"^12"^12"*^13"*^21"^22"^22"*"^23 
■^21 ~*22 "*22''^23'^31 "^32"*32"**33 



(6) 



C44»aii-ax2+ai2~M3"*21*^22"^22'*"^23 
30 *^21 "^22"^ 22*^23 "^31"*^32"^32'^^33 

Because of the duplication among image signals, 
combinations (6) reduce to (in part) 



35 



2Al 
GMPt 
WlPO 
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*^ll"*ll'''2ai2"'^13'*"2*2l''^22'''2^23'**31 



*^12"ni"*13"^2^2l"2a23-^3l"*33 

°13"*ll'*2ai2**i3'*'2*21"^22'''2a23"'^31 
-2aj2'+*33 



(7) 



10 



15 



20 



25 



30 



35 



*^44"ni"M3**31''^33 

Figure 3 is a list of the sixteen arrays of 
multipliers (ranging from 0 to ±4) used in these 
sixteen arithmetic coiablnatioas for generating th'- 
corresponding sixteen coefficient signals c^j. 
(As with the 4 by 4 Walsh-Hadamard transform, it is 
evident from Figure 3 how to construct the linear 
combinations not shown above). The list of arrays 
in Figure 3 can also be derived by inspecting Figure 
2 and combining like signals. In other words, by 
applying the same weight of ±1 to each signal value 
as shown in the arithmetic combinations of Figure 2 
and combining the weights for the elements used more 
than once, the sixteen combinations illustrated in 
Figure 2 are condensed into the sixteen "collapsed" 
arithmetic combinations of Figure 3. When 
incorporating these modifications, the 
Walsh-Hadamard transform will be hereinafter 
referred to as a "collapsed" Walsh-Hadamard _ 
transform since the characteristic linear 
combinations are "collapsed" upon a smaller field of 
image elements than is conventional in the prior art. 

An image processing method incorporating 
the "collapsed" Walsh-Hadamard transform is 
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implemented as shown in block form in Figure 4. 
This method is generally of the type described in 
the aforementioned patent application Serial No. 
522,284. Parts of the method especially relating to 

5 the "collapsed" transformation are shown in 

accordance with the present invention. Conventional 
scanning and sampling apparatus 10 generates a 
stream of image signals by scanning a photographic 
negative 20. Each signal relates to the light value 

10 of a respective element of an original image on the 
negative 20. This signal stream » hereinafter called 
signal stream S, is processed through three stages. 
Each stage conveys signals sensitive to particular 
spatial components of the image: a first stage 30 

15 conveys fine detail signals, a second stage 40 
conveys intermediate detail signals and a third 
stage 50 conveys coarse detail signals. Noise 
signals, due to photographic grain, are distributed 
across all stages. The spatial scale of the noise 

20 signals in each stage corresponds to the spatial 
scale of the corresponding detail. 

The "collapsed" 4 by 4 Walsh-Hadamard 
transform is used in each of the three stages shown 
in Figure 4. Since each stage processes differently 

25 scaled detail and the same number of transform 

coefficient signals are available in each stage, the 
image signals generated for each stage after the 
first should be filtered or processed versions of 
either the original image signals or those signals 

30 processed in some preceding stage. For that 

purpose, suitably low-pass prefiltered image signals 
related to the average light value of areas of the 
original image are provided in the second and third 
stages by use of averaging prefilters 72b and 72c. 
, 35 In the averaging prefilter 72b each image signal of 
the original image is replaced by a weighted average 



wo 85/00908 



PCT/US84/01133 



-17- 

over a neighborhood of the original image signal in 
accordance with the weighting pattern of Figure 5A. 
In the averaging prefilter 72c, each of the 
once -averaged image signals is replaced by a 
5 weighted average over the larger neighborhood of 

once -averaged signals as indicated by the pattern of 
Figure 5B (in each case, the signal being replaced 
corresponds to the center weight of 4). 

Although sixteen image signals are being 

10 transformed at one time in each stage, the sampling 
pattern of the image signals forming each 3 by 3 
signal array processed by the "collapsed" 
Walsh -Hadamard transform, i.e., whether the signals 
comprising each array are adjacent or separated by 

15 "intervening" image signals, will depend on which 

stage is involved. Figure 6 illustrates the pattern 
of particular image signals selected for the 
"collapsed" Walsh -Hadamard transformation at each 
stage. The letter x represents the image signals 

20 (including averaged image signals in the case of the 
second or third stage) selected at a particular 
moment to form the 3 by 3 signal arrays at each 
stage, while the dashes represent image signals (or 
averaged image signals) that do not provide inputs 

25 to the respective pattern at that moment. 

In each stage, the continuous stream of 
such signal arrays effects a shifting of block 
boundary locations between successive blocks so as 
to cause block/block overlap. If the block/block 

30 overlap amounts to a shift of a single image element 
from the previous block, the selection of the array 
(3) of nine image signals for transformation attach 
stage means that each image signal in each stage 
contributes to the transformation of nine arrays (3) 

35 of image signals. (More information regarding a 
block overlap transformation procedure is found in 
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the aforementioned U.S. Patent No. 4,442,454.) 
However, since each image signal in any stage after 
the first is a filtered version of some preceding 
image signal, the nine image signals selected for 
5 transformation in such stages already include 

contributions from neighboring image signals due to 
the filtering process. 

Referring again to Figure 4, the stream of 
image signals S is directly presented to a delay and 

10 alignment network 70a in the first stage and to the 
averaging pref liter 72b in the second stage; from 
the second stage the once-averaged image signals are 
presented to the averaging pref liter 72c. In 
addition, the stream of signals S bypass all stages 

15 on a line 68. In the first stage 30, the delay and 
alignment network 70a presents an array of image 
signals to a transform network 74a for effecting the . 
"collapsed" Walsh^Hadamard transformation. The 
atream of once -averaged image signals from the 

20 ptrefilter 72b is applied to a delay and alignment 
network 70b in the second stage 40 > which presents 
an array of once -averaged image signals to a 
transform network 74b for effecting the "collapsed" 
Walsh-Hadamard transformation. The stream of 

25 twice -averaged image signals from the pref liter 72c 
is applied to a third delay and alignment network 
70c, which presents an array of twice-averaged image 
signals to a transform network 74c for effecting the 
"collapsed" Walsh*Hadamard transformation in the 

30 third stage 50. 

Each delay and alignment network 70a, 70b 
and 70c is so configured as to map the array (3). of 
particular image signals that are selected (relative 
. to the image signal locations x of Figure 6) into 

35 the larger signal array (4) for the 4 by 4 

"collapsed" Walsh--Hadamard transformation at each 
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stage. That is, in the first stage 30 the 4 by 4 
"collapsed" Walsh-Hadamard transform operates on 



assembled from nine image signals frdm the incoming 
signal stream S. In the second stage 40 the 4 by 4 
"collapsed" Walsh -^Hadamard transform operates on 
sixteen image signals assembled from nine image 
signals taken from the next adjacent image signals 
of next adjacent rows of the once-averaged image 
signals presented by one alignment of the incoming 
stream of signals. In the third stage 50, the 4 by 
4 "collapsed" Walsh-Hadamard transform operates on 
sixteen image signals assembled from nine image 
signals taken from fourth adjacent image signals of 
fourth adjacent rows of the twice -averaged image 
signals presented by one alignment of the incoming 
stream of signals. In the next alignment of the 
incoming stream of image signals, new sets of nine 
image signals are presented to the delay and 
alignment stages, which present sixteen image 
signals to the respective transform metworks* Every 
image signal therefore enters into nine image signal 
arrays in each stage (assuming one image element 
displacement between overlapped blocks). As a 
result of the second and third stages of processing 
averaged image signals, a large number of elements 
of the original image influence the reconstruction 
of each image element in the processed image. 

Each transform network 74a, 74b and 74c 
transforms the image signals by a set of linear 
combinations (characteristic of the 4 by 4 
Walsh-Hadamard transform) into a corresponding set 
of coefficient signals representative of a smoothed 
light value and differences in light value between 
image elements. (Smoothed light value is meant to 
include average, weighted average or other kinds of 



sixteen image signals (some being the same) 
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mean light values) • The application of the sixteen 
arithmetic combinations defined by the arrays of 
* Figure 3 represents this process for the "collapsed" 
4 by 4 Walsh^Hadamard transform. These arithmetic 
5 combinations generate the 4 by 4 array (5) of 
coefficient signals c^j . Sets of these 
coefficient signals are presented to respective 
clipping /removal circuits 76a, 76b and 76c, each of 
which have clipping levels chosen according to the 

10 expected noise levels (that is, ndise as expressed 
in the transform coefficient signals conveyed 
through each of the stages). This being a clipping 
type of noise reduction process, coefficient signals 
less than the clipping levels- -representing most of 

15 the noise— are passed unaffected to inverse 

transform networks 78a, 78b and 78c; coefficient 
signals greater than the clipping 
levels -^"-representing mos t of the image 
information *-are set to zero«^ 

20 The results of the inverse transformation 

in the inverse transform networks 78a, 78b and 78c 
constitute arrays of processed signal components 
a'^j corresponding to the image signal locations x 
shown in Figures 6A, 6B and 6C respectively. These 

25 processed signal components are presented to 

respective assembly /averaging networks 80a, 80b and 
80c in which the nine signal components (due to 
block/block overlap in each stage) pertaining to . . 
each image element are assembled by properly 

30 arranged delay elements and averaged together. The 
averaged, processed image signals (now predominantly 
noise) from each stage are then presented to the 
delay, alignment and summing network 82, which 
provides delays to compensate for the delays 

35 incorporated in the respective stages, aligns the 

processed image signals and subtracts these signals 
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(which are predominantly noise signals) produced by 
all three stages from the unmodified full-band image 
signal presented on the line 68. 

In accordance with the teaching of the 
5 heretofore cited patent application Serial No. 
522,284, the coefficient signals Cj^j^, C]l2^ ^21 
and C22 resulting from the four arithmetic 
operations outlined in broken line 92 (Figure 3) are 
set aside and not used during inversion. By 

IQ regenerating the image signals from the signals 
resulting from the remaining twelve coefficient 
operations (which were clipped in the circuits 76a, 
76b and 76c and inverted In the networks 78a, 78b 
and 78c), the objectionable artifact of "false 
edges" is reduced. By using the "collapsed" 
Walsh -Hadamard transform on a 3 by 3 block of image 
elements, local low contrast detail— such as low 
contrast edges — is better preserved than if the 
Walsh-Hadamard transform was used in conjunction 

20 with a 4 by 4 block of image elements. 

Consequently, a better balance is struck between 
artifact and image structure than is known to the 
prior art. 

An image processing method employing a 

25 "coMapsed" Walsh-Hadamard transform according to 
the present invention may be implemented by 
application of conventional digital hardware or by 
suitable programming of a digital computer. Such 
digital circuit design or software programming is 

3Q conventional and within the capability of one of 
ordinary skill in these arts, given the preceding 
descriptions of the method in accordance with the 
invention. One implementation in conventional 
digital hardware is described in relation to Figures 

35 7-14.. In this connection, portions of the block 
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diagram of Figure 4 constituting the respective 
filter stages are enclosed in broken lines «^ 
Henceforth, the box 100 will be referred to as the 
first stage "collapsed" 4 by 4 Walsh-Hadamard 
5 filter, the box 102 as the second stage "collapsed" 
4 by 4 Walsh-Hadamard filter > and the box 104 as the 
third stage "collapsed" 4 by 4 Walsh-Hadamard 
filter* Figure 7 illustrates a hardware 
implementation of the respective "collapsed" 

10 Walsh-Hadamard filter stages— with the assignment of 
n indicating which stage the hardware will 
implement • Regarding other portions of Figure 4, 
the averaging prefilters 72b and 72c are provided by 
the delay and summing elements shown in Figures 8 

15 and 9, respectively. The delay, aligiunent and 
summing network 82 is provided by the delay and 
Slimming elements connecting the configuration of 
inputs shown in Figure 10 • 

A number of similar components appear 

20 throughout the diagrams of Figures 7-14, as 

follows. Line and element delay units are specified 
by boxes that are labeled with an "L" or "P" 
respectively. Where appropriate, a multiple of "L" 
or "P" is specified in a single box to indicate a 

25 corresponding^ multiple unit delay. (In Figure 7, 
the variable n signifies the multiplier for the 
delay. For the first stage, n«l; the second stage, 
n=2; and the third stage, n»4») Summing points are 
specified by boxes that are labeled with an "S" and 

30 the prescribed signs of the inputs are specified by 
"+" or "-". Scaling operations are specified by 
boxes that are labeled with the division symbol-"^" 
followed by the particular divisor (i.e., scaling 
factor) employed in a specific operation. Moreover, 

35 the components for Implementing the circuits 

described by Figures 7-14 are commonly obtained 
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through ordinary supply sources. The choice of 
particular device types is well within the 
capability of those of ordinary skill in the 
electronics arts. Further device specification is 
5 believed unnecessary for practice of the method in 
accordance with the Invention. 

Keferifing concurrently to Figure 4 and 
Figures 7-l4» the stream of input image signals are 
presented simultaneously to the first stage filter 

10 100 (Figure 7 J n«l) and to the second stage 

averaging prefllter 72b (Figure 8) • The structure 
of delay, summing, and averaging units illustrated 
in Figure 8 implements the averaging pattern of 
Figure 5A. The resultant average is delivered to 

15 the second stage "collapsed" Walsh -Hadamard filter 

102 (Figure 7, n«2) and to the third stage averaging 
pref liter 72c (Figure 9). The structure of delay, 
summing J and averaging units Illustrated in Figure 9 
implements the averaging pattern of Figure SB. The 

20 resultant average is delivered to the third stage 
Walsh-Hadamard filter 104 (Figure 7, n«4) . 

Each "collapsed" Walsh-Hadamard filter 
(Figure 4) includes a 4 by 4 Walsh-Hadamard 
processor 106 (Figure 7) which is shown in greater 

25 detail in Figure 11.^ With reference to the 

components of Figures 4, 7 and 11, each processor 
106 Includes (1) the direct transform network 74a, 
74b or 74c (shown as a 4 by 4 direct Walsh-Hadamard 
transformer 108 In Figure 11) (2) the 

30 clipping /removal circuits 76a, 76b or 76c (shown as 
a magnitude comparator 110 and a multiplexer 112 in 
Figure 11) and (3) the inverse trans foinii network 
78a, 78b or 78c (shown as a 4 by 4 inverse 
Walsh-Hadamard transformer 114 in Figure 11). The 

35 network of delay units preceding the processor 106 • 
in the diagram of Figure 7 corresponds to the 
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respective delay and alignment network 70a, 70b or 
70c utilized in the respective stages of the 
apparatus of Figure 4. The delay elements leading 
to the processor 106 assemble the image signals 
5 ay resulting from the block (2) of nine sampled 
image elements A^j into an array (4) of sixteen 
image signals, some of which are duplicates of 
others* The assignment of the number n (n»l, . 2 or 
4) corresponds to the particular stage being 

10 assembled, each stage sampling the image in 

accordance with the respective patterns of Figures 
6A, 6B and 6C* The network of delay and summing 
units following the processor 106 in the diagram of 
Figure 7 corresponds to the respective assembly and 

15 averaging network 80a, 80b or 80c shown in Figure 4. 

Referring now to Figure 11, the sixteen 
input image signals ^^•••a33 (some appearitig 
more than once) are presented to the 4 by 4 direct 
Walsh-Hadamard transformer 108, which perfoxnas a 4 

20 4 Walsh-Hadamard transform on the input signals 

and generates sixteen transform coefficient signals 
^11** •^44' direct Walsh-Hadamard 

transformer 108 as shown in Figure 12 employs a 
battery of 1 by 4 arithmetic networks 116* The 

25 schematic for a single 1 by 4 :.rithmetic network 116 
operating on four image signals is shown in Figure 
13 in which the required calculations are 
implemented by a set of 1 by 2 arithmetic networks 
118, each of which is composed of a summing network 

30 shown in Figure '»4. The other 1 by 4 arithmetic 
networks of Figure 12 are the same excepting the 
respective input and output lines. - 
Certain of the Walsh-Hadamard transform 
coefficient signals are compared to respective 

35 magnitude references (i*e., thresholds) in the 

magnitude comparator 110 (Figure 11) • If any of the 
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coefficient signals have a magnitude value exceeding 
the corresponding reference, a bit is set to the 
multiplexer 1X2 causing the multiplexer 112 to set 
the corresponding coefficient signal to zero. 
5 Otherwise the input coefficient signals are switched 
to the 4 by 4 inverse Walsh -Hadamard transformer 114 
without change Four of the coefficient 
signals --those generated by the operations within 
the broken line box 92 of Figure 3— are set to 
10 zero. For implementing the inverse Walsh^Hadainard 
transform, the 4 by 4 inverse Walsh-Hadamard 
transformer 114 is constructed the same as the 4 by 
4 direct Walsh-Hadamard transformer 108 with inputs 
now being the twelve modified coefficient signals. 
15 The processed image signals a' j^j^. » .a'33 are then 

divided by sixteen and presented to the network of 
delay and summing units following the processor 106 
of Figure 7. In this network, nine signal 
components (due to block/block overlap) pertaining 
20 to each image element are assembled by the arranged 
delay elements and averaged together. 

The second and third stage "collapsed** 
Walsh-Hadamard filters 102 and 104 are implemented 
with the same arrangement of digital devices as for 
25 the first stage, the difference being thpt n is set 
to 2 and 4, respectively, to account for multiple 
delays in the networks preceding and succeeding the 
4 by 4 Walsh-Hadamard processor 106 of Figure ?• 
The averaged signals (now predominantly 
30 noise) from each "collapsed" Walsh-Hadamard filter 
stage of Figure 4 are presented to the delay, 
alignment and summing network 82, which provides- 
delays to compensate for the delays incorporated in 
the respective stages, and aligns and subtracts the 
35 signals produced by the three stages from the 

unmodified full -band signal S presented on the line 
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68. The configuration of delay and summing elements 
diagrammed in Figure 10 provides the necessary 
delay 9 alignment and summing required by the network 
82, if the full-band signal and the output signals 
from the respective "collapsed" Walsh-Hadamard 
filter stages are connected as indicated. 

While the disclosed embodiment of the 
invention describes the mapping of a 3 by 3 array of 
image signals— derived from a 3 by 3 block of image 
elements— into a 4 by 4 array of Image signals 
suitable for 4 by 4 Walsh-Hadamard transformation, 
such an example is not to be construed as limiting 
the application of the invention. In general, the 
image processing method of the invention may be 
practiced by mapping any p by q array of image 
signals --derived from the light values of b p by q 
block of image elements— into a larger m by n anay 
of image signals suitable for transformation by the 
characteristic Walsh-Hadamard combinations 
appropriate for the larger m by n array of signals. 
As one way of practicing the invention, such mapping 
may be accomplished in steps, by mapping the smaller 
p by q array into an intermediate p by n array such 
that two or more co limns of the p by n array are 
duplicates of at least one column of the p by q 
array. Then the Intermedlite p by n array is mapped 
into the larger m by n array such that two or more 
rows of the m by n array are duplicates of at least 
one row of the p by q array. In temns of the image 
signal arrays already discussed, t^e 3 by 3 array of 
image signals 
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Is mapped into an intermediate 3 by 4 array 
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such that the second and third columns of the 
Intermediate array are duplicates of the second 
column of the smaller 3 by 3 array* Then the 
Intermediate 3 by 4 array Is mapped Into the larger 
4 by 4 array 
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such that the second and third rows of the larger 4 
by 4 array are duplicates of the second row of the 

20 intermediate 3 by 4 array. Alternatively, the steps 
could be reversed; the middle row of the 3 by 3 
array could be mapped Into the middle two rows of a 
4 by 3 intermediate array, followed by the middle 
column of the 4 by 3 array into the middle two 

25 columns of the 4 by 4 array. Clearly, these 

techniques may be used to convert botween other than 
3 by 3 and 4 by 4 arrays, e.g., between 3 by 3 or 
larger arrays and 5 by 5 or larger arrays, and so 
on. Furthermore, the invention may be practiced in 

30 one dimension, that is, by converting a 1 b;" q (or p 
by 1) signal array into a larger 1 by n (or m by 1) 
signal array suitable for transformation by the- 
Walsh-Hadamard transform appropriate for the larger 
string of signals in that single dimension. 

35 The invention has been described in detail 

with particular reference to presently preferred 
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embodiments thereof, but it will be understood that 
variations and modifications can be effected within 
the spirit and scope of the invention* 
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What is claimed is: 

1. An image processing method of the type 
using a Walsh -Hadamard transformation, in which 
image aignals representative of the light value of 
5 elements of the image are grouped into arrays of 
signals prior to transformation, characterised in 
that the signals from each array are mapped into a 
larger array such that one or more image signals 
appear two or more times in the larger array and the 

10 signals constituting the larger array are then 

transformed in accordance with the Walsh -Hadamard 
combinations characteristic of the larger array. 

2^ An image processing method as claimed 
in claim 1, wherein the smaller signal array 

15 comprises a p by q array of image signals 

representative of the light value of a p by q block 
of image elements that are selected for 
transformation, characterised in that the larger 
array comprises a larger m by n array formed by 

20 mapping the signals constituting each p by q array 
into the larger m by n array such that at least one 
column of the p by q array is duplicated so as to 
provide the additional columns of the larger m by n 
array, and the signals constituting the larger m by 

25 n array are then transformed in accordance with the 
Walsh-Hadamard combinations characteristic of an m 
by n array of signals. 

3. An image processing method as claimed 
in claim 2 wherein at least one row of the p by q 

30 array is duplicated so as to provide the additional 
rows of the larger m by n array. 

4. An image processing method as claimed 
in claim 3 wherein p«q«3 and m*n«4 and wherein the p 
by q array is mapped into the larger m by n array by 

35 mapping the second column of the p by q array into 
the second and third columns of a p by n 
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intemiedlate array, and then mapping the second row 
of the p by n intermediate array into the second and 
third rows of the m by n array. 

5. An image processing method employing 
5 the Walsh -Hadamard transform in order to reduce 

noise and preserve image structure, such as low 
contrast detail.^ in a processed image that is 
derived from an array of image signals 
representative of the light value of specific 
10 elements of an image, 

characterised by: 

forming the image signals into an enlarged 
array of signals suitable for transformation, 
wherein one or more of the image signals are 
15 used more than once to occupy the additional 

rows and /or columns of the enlarged array; 

transforming the signals constituting the 
enlarged array by means of the Walsh-Hadamard 
transform into a set of coefficient signals; 
20 modifying the set of coefficient signals in 

order to reduce noise and preserve image 
structure, such as low contrast detail, in the 
processed image; and 

generating a processed image from said 
25 modified set of coefficient signals « 

6. An image processing method as claimed 
in claim 5 wherein the enlarged array is a 4 by 4 
array comprising sixteen signals and the smaller 
array of image signals comprises nine image signals 

30 derived from a 3 by 3 block of image elements- 

7. An image processing method as claimed 
in claim 5 wherein the step of modifying the se^ of 
coefficient signals comprises the steps of: 

comparing the magnitude of the coefficient 
35 signals to at least one threshold of such 
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magnitude (s) that greater coefficient magnitudes 
rarely occur due to noise alone; 

selecting coefficient signals that are less 
in magnitude than the said threshold (s ) ; and 

altering these selected coefficient signals 
by reducing their magnitudes • 

8. An* image processing method as claimed 
in claim 5 wherein 

<A) the step of modifying the set of 
coefficient signals comprises the steps of: 

comparing the magnitude of the coefficient 
signals to at least one threshold of such 
magnitude (s) that greater coefficient magnitudes 
rarely occur due to noise alone; 

selecting coefficient signals that have 
magnitudes greater than the magnitude <s) of said 
threshold (s) ; and 

altering these selected coefficient signals 
by reducing their magnitudes ; and 

(B) the step of generating a processed 
image comprises the steps of: 

generating noise signals by inverse 
transforming the sets of coefficient signals, 
some of which have been altered in a preceding 
step; and 

subtracting the noise signals from the 
full-band signal corresponding to the image 
signals representative of the light value of 
specific elements of the image. 
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